cache-advisor
Tells you when to evict items from a cache. Should be able to sustain dozens of millions of accesses per second on modern server hardware without any blocking.
features
- two-segment LRU, protects against cache pollution from single-hit items
- 256 shards accessed via non-blocking flatcombining
- local access buffer that must fill up before accessing shared state
- compresses the costs associated with each item to a
u8
using a compression technique that will converge to the overall true sum of costs over time, but allows for much less memory to be used for accounting.
api